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ABSTRACT A representative empirical bibliometric analysis of Russian journals included in the Journal Citation 
Reports-Science Edition (JCR-SE) for the time period 1995-2010 was conducted at the macro level (exclud- 
ing the subject categories). It was found that the growth in the number of articles covered by JCR (a 1.8-fold 
increase compared to 1995) is ahead of the growth rates of Russian publications (1.2-fold increase). Hence, the 
share of Russian articles covered by JCR-SE was down from 2.5% in 1995 to 1.7% in 2010. It was determined that 
the number of articles published in an average Russian journal reduced by 20% as compared to the number of 
articles in an average journal of the full data set. These facts could partly shed light on the question why Russian 
research performance is staggering (approximately 30,000 articles per year), although the coverage of Russian 
journals has expanded to 150 titles. Over the past 15 years, a twofold increase in the impact factor of the Rus- 
sian journals has been observed, which is higher than that for the full data set of journals (a 1.4-fold increase). 
Measures to improve the quality of Russian journals are proposed. 

KEYWORDS article; impact factor; Russian journal; full data set; bibliometric indicators; expected citation rate; 
JCR. 



INTRODUCTION 

It is a well-known fact that the de- 
velopment of scientometrics was 
triggered by the Science Citation 
Index (SCI) creation by Dr. E. Gar- 
field of the Institute for Scientific 
Information (ISI) 1 in 1964. This 
event has become a revolutionary 
factor not only for the development 
of a novel unique information tool, 
but it has also led to the develop- 
ment of a new scientific discipline, 
scientometrics (or more commonly 
known today as bibliometrics). Ac- 
cording to Dr. E. Garfield, "we are 
witnessing the transformation of 
bibliometric studies into a field of 
industry: the assessment of the out- 
put of the research carried out by 
universities and by scientific teams" 
[1]. Although there has been grow- 
ing dissatisfaction among members 
of the scientific community with 



1 K2001Kg. This institute belongs to the Thom- 
sonReuters (TR) company. 



the passion of bureaucrats from 
various foundations and ministries 
for all kinds of ratings and evalua- 
tions, the effect of these indicators 
on the level of funding for basic re- 
search is becoming greater. 

With the accumulation of a large 
collection of bibliographic data at 
the ISI and the simultaneous rapid 
development of computer technol- 
ogy in the United States, a new in- 
formation product was developed 
based on the interrelationships 
between the journals the Jour- 
nal Citation Reports (JCR), which 
is published annually. Since 1978, 
JCR Social Sciences Edition has 
been published. Beginning from 
2009, both editions of the JCR have 
been available online as part of the 
Web of Knowledge (WoK). JCR 
shows the relationship between cit- 
ing and cited journals and contains 
data on a journal's impact factor 
(IF). The concept of impact factor 
was proposed by Dr. E. Garfield in 



collaboration with Dr. Irving Sher 
in 1955 [2]. The introduction of this 
term contributed to an increase in 
the quality of libraries' acquisi- 
tion. However, IF quickly became 
popular as a symbol of the scientific 
prestige of a journal, although its 
value significantly varies depend- 
ing on the field of science and its 
relevance to the subject field. As 
Dr. Garfield has mentioned, "Many 
scholars and editors are currently 
making a terrible mistake thinking 
that SCI was created exclusively to 
produce its by-product, JCR. The 
major purpose of these resources 
was not only to aid information re- 
trieval but also to use it as an alert- 
ing tool, i.e., for selective dissemina- 
tion of information." [1] 

One can say it is a bulk of litera- 
ture considering the drawbacks 
and shortages of the IF, but it is 
impossible to receive a research 
grant at foreign universities, unless 
the grant applicant has publica- 
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tions in journals with a high IF. It 
is impossible to list the number of 
bibliometric studies based on the 
use of JCR statistics and devoted to 
various aspects of IF application, in- 
cluding the analysis of growth rates 
in the scientific literature by a spe- 
cific subject category, to the factors 
affecting the IF value within sub- 
ject categories, as well as to the use 
of IF by funding organizations as a 
measure to assess scientific activity 
at the level of university depart- 
ments and research groups. 

In certain field of science, exces- 
sive passion for using the IF as an 
indicator of the research activity 
efficiency and decision-making re- 
garding promotion within organi- 
zations (getting tenure), as well as 
for assessing the viability of facul- 
ties and colleges, results in negative 
consequences. Thus, it was noted 
in [3] that "the desire by research 
personnel at medical colleges in 
many countries to be published 
exclusively in journals with a high 
IF threatens the very existence of 
medical nursing journals and causes 
cessation of the publication of books 
and chapters in books for which the 
IF values are not calculated." In the 
Netherlands, the desire to be pub- 
lished exclusively in the journals 
listed in the JCR has led to cessation 
of the publication of Dutch journals 
on social sciences [4]. A significant 
contribution to the development of 
bibliometric studies related to the 
normalization of the IF in various 
fields of science has been made by 
Braun T. [5], Glanzel W, [6], and 
Leydesdorff L. [7]. 

The increasing amount of scien- 
tific literature and transformation 
of the industrial society into the 
knowledge economy have result- 
ed in an expansion of the journals' 
coverage by JCR. While the first 
JCR edition contained statistics 
on 3,000 journals, the number of 
journals in the JCR-Science Edi- 
tion increased up to 8,700 in 2010. 
According to German specialists 



[8], the reason behind the expan- 
sion of journals coverage processed 
by ThomsonReuters is due to its 
competition with Elsevier, which 
has been issuing the Scopus since 
2005. Scopus is similar to SCI to a 
significant extent. It consists of 
over 18,000 journals. The criteria 
for the selection of journals to be 
included in the Thomson Informa- 
tion Resources were thoroughly 
discussed in [9]. The IF depends 
on the language of publication, re- 
search field, and sociocultural tra- 
ditions of science. The first analysis 
of Soviet journals was performed 
by Dr. E. Garfield [10]. I. Marsha- 
kova's article devoted to a compar- 
ative analysis of the IF of Russian 
and Polish journals on mathemat- 
ics should be mentioned among the 
papers that discussed the analysis 
of Russian journals IF [11]. 

No representative in-depth 
analysis of the bibliometric indica- 
tors of Russian journals has been 
performed within the past 20 years. 
The aim of this empirical study car- 
ried out at the macro level (regard- 
less of the journal's subject catego- 
ry) was to identify the trends in the 
bibliometric indicators of Russian 
journals and to compare them to 
the global trends by analyzing the 
annual sets of the JCR-Science Edi- 
tion (JCR-SE) for the time period 
1995-2010. Since only four Russian 
journals have been included in the 
JCR-Social Science Edition during 
the past decade, the data on the 
comparative analysis of these jour- 
nals against the trends in the full 
data set would not be statistically 
significant. 

The choice of the subject of our 
research is directly related to the 
reform of the basic research and 
the higher education sectors being 
carried out in Russia. This reform 
is accompanied by growing atten- 
tion by the President and the Gov- 
ernment of the Russian Federation 
to bibliometric indicators as a tool 
for research efficiency evaluation. 



On May 7, 2012, Russian President 
Vladimir Putin signed a decree on 
"Measures for the Implementation 
of the State Policy in the Field of 
Education and Science." This de- 
cree, in particular, contains provi- 
sions regarding increasing compe- 
tition among Russian universities. 
In accordance with the latter, "at 
least five Russian universities must 
be included in the list of the top 
100 best universities in the world 
by 2020, according to one of three 
World University Rankings." [12] 
Accomplishing this task is largely 
associated with the IF of the jour- 
nals in which the articles of the 
teachers of the higher education 
sector will be published. Our ear- 
lier studies have demonstrated that 
~ 60% of Russian articles included 
in the Web of Science (WoS) were 
published in Russian journals [13]. 
Meanwhile, despite the expansion 
of Russian journals coverage by 
Web of Science, the number of Rus- 
sian publications over recent years 
has remained stable and does not 
exceed 30,000 articles. Significant 
financial investments by the Rus- 
sian Government in universities 
have resulted in the fact that uni- 
versities pay authors a substantial 
amount of money for publication in 
journals covered by WoS. Further- 
more, the amount of compensation 
depends on the IF value. 

METHODS 

Issues of the JCR-SE for the time 
period 1995-2010 were used as 
the source of bibliometric statistics 
data. During the period from 1995 to 
2008, JCR was issued on CD-ROM, 
and since 2009 it has become avail- 
able as a part of Web of Knowledge 
via the Internet. Unfortunately, the 
CD-ROM for 2001 was not avail- 
able; therefore, the statistics were 
collected only for a 15-year period: 
1995-2000 and 2002-2010. 

Bibliometric statistics were col- 
lected from the JCR for each year 
for the following indicators: 
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• the number of Russian journals 
and the total number of journals; 

• share of Russian journals in JCR; 

• the annual number of articles in 
an average Russian journal and 
in an average journal of the full 
data set; 

• the average number of articles 
published in a Russian journal 
and in an average journal of the 
full data set; 

• the average IF of a Russian jour- 
nal and the average IF of a jour- 
nal of the full data set 

• the expected response for a Rus- 
sian journal. 

To calculate the expected re- 
sponse (ER) to articles published 
in a specified journal (either Rus- 
sian or one in the full data set) for 
a given year was estimated. The 
expected response is the number of 
articles published in the journal in a 
given year t multiplied by the IF of 
this journal over that year : 

£R ( _ f .IF 1 . 

i — J j i, 

where f. is the number of articles 
published by the journal over the 
year '; IF 1 , is the IF of the journal . in 
the year '; and ER*. is the expected 
response to articles published in the 
journal over the year f . 

L t is the list of journals (Rus- 
sian or total journals set) in a given 
year The total estimated response 
S_ER t to articles published in all 
journals from the list L ( over the 
year 4 was calculated according to 
the formula 

N h 

S,_ER' - YEIfj, 

j-' 

where N Lt is the total number of 
journals in the list L ( . 

The original information con- 
tained in each annual set of 
JCR-SE was uploaded into a spe- 
cial database based on the MS 
SQL Server 5. As a result, statis- 
tics were collected for each of the 



aforementioned indicators during 
each of the 15 years. 

RESULTS AND DISCUSSION 

The results of our study indicate 
that there is a steady increase in 
the number of journals indexed in 
WoS 2 , and, correspondingly, JCR: 
4,655 titles were covered by JCR- 
SE in 1995, and 8,073 titles were 
covered in 2010. In other words, 
there has been a 1.75-fold increase. 
In 1995, this database covered 108 
Russian journals; this number in- 
creased to 148 titles in 2010; i.e., a 
1.37-fold increase was observed 
(Fig. 1). The difference between the 
growth rates of the Russian and the 
full data set has a negative impact 
on Russian research output. Figure 

1 shows diagrams characterizing 
the growth rates of the Russian 
journals and the full data set. 

A significant decline was ob- 
served in 1997 (96 titles). In 1998, 
the number of journals increased to 
112. The relatively stable number 
of titles during the period between 
2004 and 2008 rose to 130 and 148 
in 2009 and 2010, respectively. The 
changes in the number of Rus- 
sian journals during the studied 
period were partially associated 
with ThomsonReuters processing 
changes: from processing Russian- 
language versions to English-lan- 
guage ones. The increase in the 
coverage of the Russian journals is 
related both to the improvement in 
the quality of Russian journals and 
competition with the Scopus, which 
covers 230 Russian titles. 

Our data regarding the growth 
of scientific literature virtually co- 
incide with the data [7] obtained 
from WoS statistics (both versions 
of the SCI-Expanded and SSCI-Ex- 
panded) for the period 2000-2008. 
According to this publication, the 
number of journals has increased 
by 29%, with an average growth 

2 Only 93-95% of Russian publications covered 
by WoS are covered by JCR-SE (Science Cita- 
tion Index-Expanded). 



rate of 3.3%. The highest growth 
rate was recorded in 2007-2008. It 
is a known fact that a journal must 
have been listed in WoS for at least 
two years before it receives an IF. 
Hence, the IFs of journals published 
in 2008 could appear in the JCR 
only in 2010. 

The growth in the global litera- 
ture is attributed to several fac- 
tors, including the development 
and globalization of science, emer- 
gence of a new research area, and 
appearance of new journals, as well 
as ThomsonReuters policy to ex- 
pand journals coverage in WoS. As 
mentioned in [12], the number of 
publications in WoS is growing rap- 
idly. Our results have shown that 
JCR-SE covered 607,049 articles 
in 1995, while the number of arti- 
cles reached 1,080,209 in 2010 (i.e., 
a 1.78-fold increase was observed). 
The number of Russian articles cov- 
ered by JCR-SE has also increased; 
however, only a 1.22-fold increase 
was observed. The proportion of 
Russian articles among the total 
number of publications covered by 
JCR-SE was down from 2.48% in 
1995 to 1.7% in 2010. 

Our goal was to find out to what 
extent the increase in the total 
number of Russian articles is associ- 
ated with the expansion in the jour- 
nal coverage by JCR-SE or whether 
the growth is attributed just to the 
increase in the number of articles 
per single average journal. So we 
investigated the trends of a single 
average Russian journal and a jour- 
nal from the total journals' set over 
the studied period. Fig. 2 shows two 
diagrams characterizing the trends 
of both types of journals. 

The data presented in Fig. 2 
demonstrate the "ups" and "downs" 
in the average number of articles 
per single Russian journal. The 
sharp fall shown in the diagram for 
2006 is obviously associated with 
the changes that were occurring at 
that time at the Nauka publishing 
house and at the company respon- 
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Fig. 1 . Growth rate of the number of Russian journals and the total number of 
journals covered by JCR-SE as compared to that in 1995 



160 



140 



120 



100 



80 



60 



40 



20 




Russian journals 



• Total number 
of journals 



1995 1996 1997 1998 1999 2000 2002 2003 2004 2005 2006 2007 2008 2009 2010 



Fig. 2. Changes in the number of articles per single average Russian journal and 
per journal among the total number of journals covered by JCR-SE 



sible for the translation of Russian 
journals. Over all, the number of 
articles per single average Russian 
journal fell by 18.3% (or 20 articles) 
as compared to 1996. An opposite 
trend was evident in the total jour- 
nals set: a 1.9% growth rate was ob- 
served. A conclusion can be drawn 
that the significant decrease in the 
number of articles (by almost 20%) 
per single Russian journal that has 
occurred over the past 15 years is 
one of the main reasons for the lack 
of growth in Russian research out- 
put. 

In order to assess all the causes 
of the stagnation in the number 
of Russian publications, one needs 
to collect statistics related to all 
the articles of Russian researchers 
published in foreign journals. We 
compared the number of Russian 
publications covered by WoS to 
that covered by JCR-SE between 
2006 and 2010. These data are listed 
in Table 1. 

It is clear from Table 1 that the 
number of articles published in 
Russian journals increased signifi- 
cantly during the period 2009-2010. 
The share of Russian publications in 
foreign journals remains high. This 
demonstrates that Russian science 
remains part of global science. 

A journal's IF plays an impor- 
tant role in evaluating a scientist's 
performance (however, too much 
significance is often attached to it). 
In 2005, the average IF of a single 
Russian journal was 0.27 compared 
to 1.3 IF for a journal in the full data 
set and that of a journal among the 
full data set was 1.3; i.e., there was a 
4.8-fold difference. During the sur- 
vey period, a tendency toward in- 
creased IF values was observed for 
journals in both groups. These data 
are presented in Fig. 3. 

The average IF of a Russian jour- 
nal for the studied period has in- 
creased 1.75-fold, although it still 
remains relatively low. However, 
despite the obvious difference in the 
IF values between the two groups of 



VOL. 5 J\f°3(18) 2013 | ACTA NATURAE | 9 



FORUM 



Table 1 . Share of articles published in Russian journals, % 



Year 


Share of articles published in Russian journals, % 


2006 


44.6 


2007 


46.3 


2008 


43.7 


2009 


45.8 


2010 


53.6 




0 

1995 1996 1997 1998 1999 2000 2002 2003 2004 2005 2006 2007 2008 2009 2010 
-o- IF, full data set -°- IF, Russia 



Fig. 3. Trends in the IF values of journals during the period 1995-2010 accord- 
ing to JCR-SE 



journals this difference slightly nar- 
rowed in 2010: there was a 4.8-fold 
gap between the IF values in 1995, 
while in 2010 it had shrunk to 4.1 
times. The period between submis- 
sion of the manuscript to a Russian 
journal and its publication exceeds 
one year; hence, there is an almost 
zero probability that the publication 
will be cited during the same year. 
This is only one of the reasons why 
the IF of Russian journals is signifi- 
cantly lower than that of foreign 
ones. Among the full data set, the 
share of publications on life sciences 
and clinical medicine amounts to 
over 70%. These fields of science are 
characterized by high citation rates 
and the highest IFs. The pattern of 



distribution of Russian journals over 
the fields of science is completely 
different: sciences known as "hard 
science" (i.e., physics, chemistry, 
mathematics, materials science, 
Earth sciences) account for ~80%. 
The citation scores of these fields 
are significantly lower. This fact also 
considerably affects the relatively 
low average IF value. 

As mentioned above, the IF of 
a journal is becoming increasingly 
important as Russian universities 
offer additional financial rewards to 
uthors, which depend on the jour- 
nal's IF [13]. Certain universities 
are developing an evaluation meth- 
odology depending on the national 
identity of a journal: either Russian 



or foreign (htpp : / / urf u / f ileadmin / 
user_upload/ docs /science /Pr i- 
kaz_122_2013.pdf), 

The highest IF values among 
Russian journals have been con- 
ventionally assigned to the review 
journals Physics-Uspekhi and Rus- 
sian Chemistry Review. In assessing 
the scientific productivity, a special 
weighted indicator is assigned not 
only to the IF, but also to which 
percentage group a journal belongs 
to in the subject category as was 
described by Dr. E. Garfield [14]. 

The journals assigned to a partic- 
ular subject category and ranked by 
the highest value of the IF, which 
account for the first 25%, are con- 
sidered to be the most important 
ones. This research has resulted in 
the widespread application of the 
25% subject category journals both 
abroad and in Russia. For instance, 
the lecturers at Moscow State 
University receive an additional 
monthly financial reward for the 
publication of articles in the inter- 
national journals included in the top 
25% of subject category according 
to the Web of Science classification 
htpp://istina.imec.msu/statistics/ 
journals/top. 

As we have mentioned above, 
the IF strongly depends on the sub- 
ject category, since the citation rate 
between immunology and mathe- 
matics differs by almost an order of 
magnitude. The list of Russian jour- 
nals in the JCR-SE for 2010 contains 
only nine journals with IF higher 
than one. However, only a few of 
them have been listed in the top 25 
or 50% most prestigious journals in 
the relevant subject category. Table 
2 contains data on these journals. 
It is noteworthy that among eight 
journals of this category, three are 
mathematics journals with IFs sub- 
stantially lower than one. 

A number of Russian journals 
with relatively high IFs were not in- 
cluded even in the top 75% of jour- 
nals. This applies to Biochemistry, 
which ranks fourth among Russian 
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Table 2. Russian journals included in the top 25 and 50% of the corresponding subject category 



Journal 


Impact 
factor 


Rank among 
the Russian 
journals with 
respect to IF 


Rank in the 
JCR subject 
category 


Subject category 


Number of 
journals in 
the subject 
category 


The size of the 
share in the 
JCR subject 
category, % 


Laser Physics 


1 oco 
l.oOZ 


c 
0 




Optics 




rh 
5U 


Physics-Uspekhi 


0 OAR 


Z 


1 Q 


Interdisciplinary 
sciences, physics 


on 
oU 


OR 

ZD 


Russian Chemistry Review 


Z.o4tD 


i 
1 




Interdisciplinary 
sciences, chemistry 


1 R/l 
104 


5U 


j iii i Jr .Letters 


l.DD / 


o 
o 


oZ 


Interdisciplinary 
sciences, physics 


on 
oU 


en 
OU 


Functional Analysis and Its 
Applications 


n coo 
U.OOO 


ZD 


1 HQ 


Mathematics 


07Q 

z / y 


cn 
OU 


Moscow Mathematical 
Journal 


0.721 


21 


93 


Mathematics 


279 


30 


Journal of Mathematical 
Physics 


1.131 


6 


28 


Interdisciplinary 
sciences, physics 


55 


50 


Journal of Experimental 
and Theoretical Physics 


0.946 


12 


41 


Interdisciplinary 
sciences, physics 


80 


50 



journals, with an IF of 1.402. This 
journal belongs to the "Biochemis- 
try and molecular biology" subject 
category, consisting of 286 journals. 
Biochemistry in this subject catego- 
ry ranks 234 th , and it was not even 
included in the top 75%. Another 
example is Astronomy Letters, with 
an IF value of 1.091, which ranks 
8 th among Russian journals with 
respect to the IF and 36 th among 55 
journals in the "Astronomy and as- 
trophysics" subject category. This 
journal belongs to the 75% group. 
The remaining Russian journals 
have relatively low rankings in 
their relevant subject categories. 
We consider it necessary to bolster 
the credibility of Russian journals 
in the eyes of the international sci- 
entific community. It would be rea- 
sonable to invite foreign colleagues 
to join editorial boards and to pro- 
vide each issue of the journal with 
content in English. The authors 
have to provide an abstract and 
a list of keywords in the Russian 
and English languages. The articles 
should to be accompanied by a list 
of references. The establishment 



of language counseling centers for 
assistance in editing the articles 
written by Russian authors in the 
English language seems relevant. 
Publications by leading scientists in 
Russian journals contribute to the 
development of Russian science and 
could guide young researchers in 
their scientific endeavors. Since the 
Ministry of Education and Science 
of the Russian Federation attaches 
great importance to the bibliomet- 
ric indicators of Russian science, it 
could use the experience of foreign 
universities and colleges, which 
have special training courses that 
teach how to prepare articles and 
reports, technical papers, and grant 
applications. 

The expected response (ER) to 
journal articles is the number of ar- 
ticles multiplied by the journal IF in 
a specific year. In order to calculate 
the expected response of the aggre- 
gate of Russian journals (or that of 
the full data set), the sum of these 
products throughout the entire giv- 
en set (Russian journals or the full 
data set) for the year under study 
is used. It can be noted that a maxi- 



mum expected response is observed 
for the articles published in Russian 
journals twelve years ago. The falls 
on the curve are associated with the 
technological changes in the jour- 
nals' processing as has been men- 
tioned above. 

It should be mentioned that these 
response data only apply to Russian 
articles published in Russian jour- 
nals. Since over 45% of Russian ar- 
ticles are published in foreign jour- 
nals, the total response to Russian 
articles is much higher. 

CONCLUSIONS 

A representative empirical biblio- 
metric analysis of the Russian jour- 
nals covered by Journal Citation 
Reports-Science Edition (JCR-SE) 
for the period 1995-2010 has been 
conducted for the first time at the 
macro level (excluding subject cat- 
egories). 

The growth of the total number 
of articles (1.8-fold increase) as com- 
pared to 1995 outpaces the growth 
rates of Russian publications (1.2- 
fold increase). As a result, the share 
of Russian articles among the total 
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number of publications decreased 
from 2.49% in 1995 to 1.71% in 2010. 

It was determined that the 
number of journals among the full 
data set and that of Russian jour- 
nals increased by factors of 1.75 and 
1.37, respectively. 

Over a 15-year period, the 
number of articles published in a 
single average Russian journal has 
decreased by 17.9% as compared to 
that in 1995. An increase by 1.9% 
was observed for the full data set. 
This fall is the reason behind the 
stagnation in the Russian research 
output for the period 2008-2010, 
despite the increase in the number 
of Russian journals covered by Web 



of Science. Another cause is the de- 
cline in the share of Russian jour- 
nals in the total number of journals 
covered by Web of Science from 
2.34% in 1995 to 1.83% in 2010. 

Despite the fact that the weight- 
ed average IF of Russian journals 
remains significantly lower than 
that of the journals among the to- 
tal number of journals, it increased 
1.96-fold as compared to that in 
1995. Meanwhile, the weighted av- 
erage IF of the full data set is char- 
acterized by a 1.42-fold increase. 

Our data provide reliable statis- 
tics for policy makers and edito- 
rial boards. In order to improve the 
bibliometric indicators of Russian 



science, it is necessary to improve 
the quality of Russian journals 
translation into English. Further- 
more, a program for graduate and 
undergraduate students on "How 
to prepare a research paper" is re- 
quired. The Ministry of Education 
and Science of the Russian Federa- 
tion should play a key role in this 
preparation. • 

The authors are grateful to 
the Russian Foundation for 
the Humanities for financial 
support (grant JVe 12-70000) 
and to Thomson Reuters for the 
opportunity to use the data. 
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